Updating zone information in a distributed switch of data forwarders

ABSTRACT

Provided are a computer program product, system, and method for updating zone information in a distributed switch of data forwarders. For each data forwarder, a sequence number is maintained for zone distribution messages sent to the data forwarder. A change to the ports in the network is detected comprising at least one of an allocation or deallocation of at least one port in the network. The sequence number for each data forwarder is incremented in response to detecting the change. For each data forwarder, a zone distribution message is generated indicating the at least one port allocated and/or deallocated, port information indicating each port in the network that may communicate with each other port, and the sequence number for the data forwarder. The generated zone distribution message is transmitted for each data forwarder to the data forwarder for which the zone distribution message was added.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a computer program product, system, andmethod for updating zone information in a distributed switch of dataforwarders.

2. Description of the Related Art

A distributed switch includes a plurality of interconnected forwardersthat provide ports to interconnect host ports. In a distributed FibreChannel over Ethernet (FCoE) forwarder, a controlling FCoE forwarder(cFCF) is in communication with one or more FCoE data forwarders (FDFs)over an Ethernet network. The cFCF and connected FDFs provide FibreChannel connections to hosts in a Fibre Channel Fabric. The cFCFmaintains zone information for the network in which the distributed FCFoperates and updates the zone information of the FDFs with changes tozone information, such as the allocation and deallocation of ports.

The forwarders in the distributed switch use the zone information todetermine whether host ports may communicate with target ports in thenetwork.

There is a need in the art for improved techniques for managing theupdating of zone information among the forwarders in a distributedswitch comprised of interconnected forwarders.

SUMMARY

Provided are a computer program product, system, and method for updatingzone information in a distributed switch of data forwarders. For eachdata forwarder, a sequence number is maintained for zone distributionmessages sent to the data forwarder. A change to the ports in thenetwork is detected comprising at least one of an allocation ordeallocation of at least one port in the network. The sequence numberfor each data forwarder is incremented in response to detecting thechange. For each data forwarder, a zone distribution message isgenerated indicating the at least one port allocated and/or deallocated,port information indicating each port in the network that maycommunicate with each other port, and the sequence number for the dataforwarder. The generated zone distribution message is transmitted foreach data forwarder to the data forwarder for which the zonedistribution message was added.

In further embodiments, zone information is maintained indicating eachport that may communicate with each other port in the network and a lastreceived sequence number included in a last accepted zone distributionmessage. A zone distribution message is received from a controllingforwarder indicating at least one port allocated and/or deallocated,port information indicating each port in the network that maycommunicate with each other port, and the sequence number indicating asequence number of the zone distribution message. A determination ismade as to whether the sequence number in the zone distribution messageis greater than the last received sequence number. The zone informationis updated to indicate the at least one port allocated and/ordeallocated and include information on the ports in the network that maycommunicate with each other port in response to determining that thesequence number in the zone distribution message is greater than thelast received sequence number.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an embodiment a distributed switch.

FIG. 2 illustrates an embodiment of an access control list (ACL) entry.

FIG. 3 illustrates an embodiment of a zone distribution message.

FIG. 4 illustrates an embodiment of data forwarder entry.

FIG. 5 illustrates an embodiment of controlling forwarder operations toupdate zone information for the network.

FIGS. 6 and 7 illustrate an embodiment of data forwarder operations toprocess a zone distribution message.

FIG. 8 illustrates an embodiment of controlling forwarder operations toprocess a rejection of a zone distribution message.

FIG. 9 illustrates an embodiment of zone reset operations.

FIGS. 10-13 illustrate examples of the processing of zone distributionmessages according to the operations of FIGS. 5-9.

DETAILED DESCRIPTION

In prior art distributed switches comprised of forwarders, if zonedistribution messages are received and processed by the data forwardersout of order, then the zone information at the data forwarders may notinclude ACL entries for ports that have been allocated in the network ifthe zone distribution messages allocating the ports have not yetarrived. Further, if a zone distribution message is received out oforder, then it may provide links for ports not yet allocated in the zoneinformation at the data forwarder. The data forwarder would not be ableto include the links in the zone distribution message in the zoneinformation for the port for which the data forwarder has not yetreceived the zone distribution message allocating the port. Further, ifa zone distribution message deallocating a port is received out oforder, then the port may not be properly deallocated before other linksare added, which may result in security issues if links remain for portsthat should have been deallocated from the zone information before otherlinks are added.

Described embodiments provide techniques for handling the receipt ofzone distribution messages out of sequence by the controlling forwardersby providing a sequence number with zone distribution messages so thatthe data forwarder will reject a zone distribution message having asequence number less than a sequence number of a last accepted andprocessed zone distribution message. Rejection of a zone distributionmessage causes the controlling forwarder to rebuild a zone distributionmessage to allocate or deallocate the port, as indicated in the rejectedmessage, and update the peering entries in the message to indicate thecurrent connections.

FIG. 1 illustrates an embodiment of a network computing environment 1including a distributed switch 2 comprised of a controlling forwarder 4and one or more data forwarders 6 a, 6 b. The forwarders 4, 6 a, 6 binclude ports 8 a, 8 b, 8 c, 8 d, 8 e, 8 f, to connect the distributedswitch 2 to ports 10 a, 10 b, 10 c, 10 d, 10 e, 10 f of hosts 12 a, 12b, 12 c, 12 d, 12 e, 12 f, respectively, and a port 8 g connecting to afirst network fabric 14 having further hosts and devices. Thecontrolling forwarder 4 communicates via port 8 h with the dataforwarders over a second network 16 via data forwarder ports 8 i and 8j.

The controlling forwarder 4 includes a controlling forwarder (CF)controller 20 to perform the controlling forwarder 4 operations; zoneinformation 22 providing information on ports in the network and theports with which each port may communicate; and data forwarderinformation 24 on the data forwarders 6 a, 6 b in the distributed switch2.

Each data forwarder 6 a, 6 b includes a data forwarder (DF) controller26 a, 26 b, zone information 28 a, 28 b providing information on portsin the network and the ports with which each port may communicate, and asequence number 30 a, 30 b indicating a sequence number included in alast accepted and processed zone distribution message from thecontrolling forwarder 4.

The controlling forwarder 4 manages zone information of ports that maycommunicate with other ports in the network 1 for the distributed switch2. When ports are allocated and deallocated in the network 1, thecontrolling forwarder 4 transmits information on the port updates to thedata forwarders 6 a, 6 b so that the data forwarders 6 a, 6 b may updatetheir local zone information 28 a, 28 b. The data forwarders 6 a, 6 buse their local zone information 28 a, 28 b to determine whether a hostport 10 a-10 f, transmitting data or a message, may communicate with atarget port of the communication.

Although two data forwarders 6 a, 6 b are shown, there may be additionaldata forwarders in the distributed switch 2 managed by the controllingforwarder 4 and/or additional controlling forwarders. Further, thedistributed switch 2 may connect to additional distributed switches inthe network. The hosts 10 a-10 f may comprise servers, initiators,targets, storage devices, etc.

The first network fabric 14 may comprise a Fibre Channel Fabric. Theforwarders 4, 6 a, 6 b may communicate with the hosts 12 a-12 f usingFibre Channel protocols. The second network 16 may comprise an Ethernetnetwork, such that the controlling forwarder 4 and data forwarders 6 a,6 b communicate using a Fibre Channel over Ethernet (FCoE) protocol. Insuch Fibre Channel embodiments, the distributed switch 2 may comprise adistributed FCoE forwarder (Distributed FCF), the controlling forwarder4 may comprise a controlling FCoE forwarder (cFCF), and the dataforwarders 6 a, 6 b may comprise FCoE data plane forwarders (FDFs). Theports may comprise physical ports or virtual ports providing FibreChannel links. In certain embodiments, the ports 8 h, 8 i, and 8 jconnecting the forwarders 4, 6 a, 6 b may comprise Fibre Channel VirtualA ports (VA Ports), providing virtual links.

The CF 20 and DF 26 a, 26 b controllers may be implemented as anapplication specific integrated circuit (ASIC) or a processor executingcomputer readable program instructions in a non-volatile storage, or acombination thereof. In this way, the controllers 20, 26 a, 26 b includehardware to execute code or logic to perform the operations describedherein. The controllers 20, 26 a, 26 b may include a volatile ornon-volatile memory to store zone information 22, 28 a, 28 b, dataforwarder information 24, sequence number 30 a, 320 b information, andother information used during processing.

FIG. 2 illustrates an embodiment of an access control list (ACL) entry50 that is included in the zone information 22, 28 a, 28 b of theforwarders 4, 6 a, 6 b for each allocated port. An ACL entry 50 includesa principal port 52 and one or more peer port identifiers (IDs) 54 towhich the principal port 52 may communicate. The forwarders 4, 6 a, 6 bwill allow a transmission from a source port to a target port if thereis an ACL entry 50 with the source port as the principal port 52 and thetarget port as one of the peer ports 54.

FIG. 3 illustrates an embodiment of a zone distribution message 70 thecontrolling forwarder 4 transmits to the data forwarders 6 a, 6 b toprovide information on allocated and deallocated ports in the network 1.The zone distribution message 70 includes a message code 72 identifyingthe message as a zone distribution message; an origination controllingforwarder 74 that sent the message; the allocated/deallocated port(s) 76indicating one or more ports that are allocated and/or deallocated; oneor more peering entries 78 identifying ports that may communicate withone another; and a sequence number 80 the controlling forwarder 4assigns the message 70. Each peering entry 78 identifies a principalport 82 and one or more peer port IDs 84 with which the principal port82 may communicate. In certain embodiments, the zone distributionmessage 78 indicates each port in all the zones and the ports with whichthat port may communicate. The peering entries 78 may be provided forone or more zones configured for the distributed switch 2.

In Fibre Channel embodiments, the zone distribution message 70 maycomprise a N_Port_ID and Zoning ACL Distribution (NPZD) message.

FIG. 4 illustrates an embodiment of a data forwarder entry 90 in thedata forwarder information 24 maintained by the controlling forwarder 4including a data forwarder ID 92, comprising one of data forwarders 6 a,6 b, and a sequence number 94 that indicates a sequence number of a lastzone distribution message sent to the data forwarder 92. The controllingforwarder 4 increments the sequence number 94 for a data forwarder 92each time a zone distribution message is sent to the data forwarder 92.

FIG. 5 illustrates an embodiment of operations performed by the CFcontroller 20 to change the port allocation in the network 1. If (atblock 102) a port is being deallocated, then the CF controller 20updates (at block 104) the zone information 22 to remove the ACL entry50 for the deallocated port, i.e., the ACL entry 50 having thedeallocated port as the principal port 52 (FIG. 2). The ACL entries forother principal ports are updated (at block 106) to remove thedeallocated port as a peer port 54 to indicate that no ports maycommunicate with the deallocated port.

If (at block 102) a port is being allocated, then the CF controller 20updates (at block 108) the zone information 22 to add an ACL entry 50for the allocated port, indicating the allocated port as the principalport 52, and indicate all peer ports to which the allocated port cancommunicate as the peer ports 54. All ACL entries 50 for other principalports that can communicate to the allocated port are updated (at block110) to indicate the allocated port as a peer port 54.

The CF controller 20 performs a loop (at blocks 112-120) of theoperations at blocks 114-118 for each data forwarder 6 a, 6 b (DF_(i))indicated in the data forwarder information 24. The loop at blocks112-120 ends after messages are sent to all the active data forwarders 6a, 6 b indicated in the data forwarder information 74. At block 114, theCF controller 20 increments the sequence number 94 for the dataforwarder (DFi), as indicated in the data forwarder entry 90 (FIG. 4)for DF_(i). The CF controller 20 generates (at block 116) a zonedistribution message 70 indicating, among other information, the messagecode 72; the controlling data forwarder 4 in field 74;allocated/deallocated one or more ports 76; the sequence number 94 forthe data forwarder (DFi); and a peering entry 78 for each ACL entry 50indicating each principal port 82 and the peer ports 84 to which it cancommunicate. The generated zone distribution message 70 is sent to thedata forwarder (CF_(i)).

FIG. 6 illustrates an embodiment of operations performed by the DFcontrollers 26 a, 26 b to process a received zone distribution message70. Upon receiving (at block 150) a zone distribution message 70, if (atblock 152) the sequence number 80 in the zone distribution message 70 isless than the last received sequence number 30 a, 30 b, then the zonedistribution message 70 has been received out of sequence and the DFcontroller 26 a, 26 b sends (at block 154) a rejection message to thecontrolling forwarder 4 indicating a rejection of the zone distributionmessage 70. The rejection message may identify the receiving dataforwarder 6 a, 6 b and the message, such as with the sequence number 80.The rejected zone distribution message 70 is discarded without applyingany of the changes indicated in the rejected zone distribution message70.

If (at block 152) the sequence number 80 in the zone distributionmessage 70 is greater than the last received sequence number 30 a, 30 b,then the DF controller 26 a, 26 b accepts the message 70 and updates (atblock 158) the zone information 28 a, 28 b to indicate the at least oneport allocated and/or deallocated and include information on the portsin the network that may communicate with each other port by updating theACL entries 50. FIG. 7 provides a further embodiment for updating thedata forwarder zone information 28 a, 28 b. The last received sequencenumber 30 a, 30 b is updated (at block 160) to indicate the sequencenumber 80 in the received zone distribution message 70. The DFcontroller 26 a, 26 b sends (at block 162) an accept zone distributionmessage to the controlling forwarder 4.

With the described embodiments of FIG. 6, a zone distribution message 70may be processed out-of-order if it has a sequence number 80 greaterthan the sequence number 30 a, 30 b of the last processed zonedistribution message. However, if the zone distribution message 70 has asequence number 80 less than the last accepted and received sequencenumber 30 a, 30 b, then it is rejected and not applied to update thelocal zone information 28 a, 28 b.

FIG. 7 illustrates an embodiment of operations performed by the DFcontrollers 26 a, 26 b to update their local zone information 28 a, 28 bto indicate the at least one port allocated and/or deallocated andinclude information on the ports in the network that may communicatewith each other port, such as performed at block 158 in FIG. 6. Uponinitiating (at block 180) the operation to update the local zoneinformation 30 a, 30 b, if (at block 182) a port is being deallocated,as indicated in field 76 of the zone distribution message 70, then theDF controller 26 a, 26 b updates (at bock 184) the zone information 30a, 40 b to remove the ACL entry 50 for the deallocated port. If (atblock 182) a port is being allocated, then the DF controller 26 a, 26 bupdates (at block 186) the zone information 28 a, 28 b to add an ACLentry 50 for the allocated port. The DF controller 26 a, 26 b thenperforms a loop (at block 188 through 196) of the operations at blocks190 through 194 for each peering entry (PE_(i)) 78 included in the zonedistribution message 70. If (at block 190) the zone information 28 a, 28b does not include an ACL entry 50 for the principal port 82 of thepeering entry (PEi) 78, i.e., an ACL entry 50 having as a principal port52 the principal port 82 of the peering entry (PE_(i)), then thatpeering entry (PE_(i)) is discarded (at block 192) and the connectioninformation for the discarded peering entry (PE_(i)) is not applied tothe local zone information 28 a, 28 b. If (at block 190) there is an ACLentry 50 in the zone information 28 a, 28 b for the principal port 82 ofthe peering entry (PE_(i)) 80, then the ACL entry 50 for the principalport 82 in the peering entry (PEi) 78 is updated (at block 194) toindicate the peer ports 84 indicated in the peering entry (PEi) to whichthe principal port 52 of the ACL entry 50 can communicate. Controlproceeds from block 192 or 194 to block 196 to perform another iterationof the loop of operations at blocks 188-196 until all the peeringentries (PEi) 78 in the received zone distribution message 70 areconsidered.

With the described embodiments, if a zone distribution message 70 isreceived out of order but having a higher sequence number than thesequence number 30 a, 30 b of the last received zone distributionmessage 70, then connection information is only updated for those peerentries (PEi) that concern ports indicated as allocated in the localzone information 28 a, 28 b. If a port for a peering entry is notindicated as allocated in the zone information, then that port may beadded in a previously transmitted zone distribution message 70, whichmay have not been received, having a lower sequence number than thereceived zone distribution message 70 being processed. In such case, theentries concerning the port allocated in the zone distribution that wasnot processed before the current message are not applied to the zoneinformation 28 a, 28 b because the port to which they apply has not beenallocated yet in the local zone information 28 a, 28 b.

FIG. 8 illustrates an embodiment of operations performed by the CFcontroller 20 to process a rejection message indicating rejection of anidentified zone distribution message 70 from a rejecting data forwarder6 a, 6 b, such as sent at block 154 in FIG. 6. Upon receiving (at block210) the rejection message, the CF controller 20 increments (at block212) the sequence number 94 in the data forwarder entry 90 for therejecting data forwarder 6 a, 6 b. A determination is made (at block214) of the at least one port allocated and/or deallocated 76 in therejected zone distribution message 70. The CF controller 20 may maintaina log of sent zone distribution messages 70 that have not yet beenaccepted. The CF controller 20 generates (at block 216) a new zonedistribution message 70 indicating the determined at least one portallocated and/or deallocated in the identified rejected zonedistribution message, the sequence number, and peering entries 78 foreach port and the ports with which the port may communicate. The newzone distribution message 70 is transmitted (at block 218) to therejecting data forwarder 6 a, 6 b, which it will accept because thisrebuilt zone distribution message 70 has the highest yet generatedsequence number.

With the operations of FIG. 8, the rebuilt zone distribution message 70indicates the one or more ports indicated as allocated/deallocated inthe rejected message and indicates peering entries 78 based on thecurrent ACL entries 50 in the zone information 22, thus providing thecurrent state of network port connections for the zones.

FIG. 9 illustrates an embodiment of operations performed by the CFcontroller 20 as part of a zone reset, when all the zone information isbeing reset. Upon initiating (at block 240) a zone reset operation, theCF controller 20 resets (at block 242) the sequence numbers 94 for thedata forwarders 6 a, 6 b in the data forwarder entries 90 to an initialvalue, e.g., zero. The CF controller 20 sends (at block 244) a zonereset message to the data forwarders 6 a, 6 b, which causes the dataforwarders 6 a, b to reset their zone information 28 a, 28 b and resettheir zone distribution message sequence numbers 30 a, 30 b to aninitial value, e.g., zero. In Fibre Channel embodiments, the zone resetmessage may comprise an Active Zoning ACL Distribution (AZDL) message.The data forwarders 6 a, 6 b reset their sequence numbers 30 a, 30 b inresponse to the zone reset message or upon establishment of a firstcommunication path between the data forwarder and the controllingswitch. The sequence numbers at the controlling forwarder 4 and the dataforwarders 6 a, 6 b may also be reset when a virtual link is establishedbetween the controlling forwarder 4 and the data forwarders 6 a, 6 b.The zone reset message may be sent when the virtual links areestablished to also initialize the sequence number at this time.

FIG. 10 illustrates an example of the result of the operations performedin FIGS. 5-9 on zone information when processing four zone distributionmessages ZDM 1, ZDM 2, ZDM 3, ZDM 4 for ports A, B, and C. ZDM 1, 2, and3 are sent to allocate ports A, B, and C, respectively, and provide peerinformation for the ports, as indicated by the arrows connecting ports.In ZDM 1, the first port A is allocated, with no connections. In ZDM 2,port B is allocated with peering entries for links between A and B. InZDM 3, port C is allocated with peering entries for links between A, B,and C. FIG. 10 shows a timeline 250 of when the zone distributionmessages sent from the controlling forwarder (CF) 4 are received at thedata forwarder (DF) 6 a, 6 b, which shows that the data forwarder (DF)receives ZDM 3 before ZDM 2. Because the messages are sent out of order,the data forwarder (DF) sends a rejection message (RJT) with respect toZDM 2, which causes the controlling forwarder (CF) to send a rebuiltmessage according to the operations of FIG. 8 that indicates the port Ballocated in the rejected ZDM 2 and includes all the peering entries forthe current state of the ports A, B, C. The ACL entries 252 shows howthe data forwarder (DF) 6 a, 6 b adds ACL entries 50 to the zoneinformation 28 a, 28 b as a result of ZDM 1, ZDM 3 (receivedout-of-sequence after ZDM 1) and ZDM 4 For ZDM 3, the data forwarder(DF) 6 a, 6 b performs the operations of FIGS. 6 and 7, adds ACL entries254 for ports A and C, but not for port B because port B had not beenallocated yet in the zone information 28 a, 28 b, which occurs with theZDM 2 that has not yet been received when ZDM 3 is processed out oforder. Upon receiving ZDM 4 and adding allocated port B, the dataforwarder (DF) 6 a, 6 n may then add ACL entries 256 for all ports A, B,C in the network 1.

FIG. 11 illustrates an example of the result of the operations performedin FIGS. 5-9 on zone information when processing three zone distributionmessages ZDM 1, ZDM 2, and ZDM 3 for ports A, B, and C. ZDM 1 is sent toallocate port C and provide peer information for ports A, B, and C. InZDM 2, port B is deallocated and provides peering entries for linksbetween A and C. In ZDM 3, port C is allocated with peering entries forlinks between A and C. FIG. 11 shows a timeline 260 of the zonedistribution messages sent between the controlling forwarder (CF) 4 anda data forwarder (DF) 6 a, 6 b, which shows that the data forwarder (DF)receives ZDM 2 before ZDM 1. Because the messages are sent out of order,the data forwarder (DF) sends a rejection message (RJT) with respect toZDM 1, which causes the controlling forwarder (CF) to send a rebuiltzone distribution message ZDM 3 according to the operations of FIG. 8that indicates the port C allocated in the rejected ZDM 1 and includesall the peering entries for the ports A and C, because B wasdeallocated. The ACL entries 262 shows how the data forwarder (DF) 6 a,6 b adds ACL entries 50 to the zone information 28 a, 28 b as a resultof ZDM 2 and the rebuilt message ZDM 3 Initially, there are ACL entries264 for ports A and B. For ZDM 2, the port B ACL entry is removed,leaving ACL entry 266 for port A, but no ACL entry for port C because,according to the operations of FIGS. 6 and 7, port C had not beenallocated yet in the zone information 28 a, 28 b, which occurs with theZDM 1 that has not yet been received when ZDM 2 is processedout-of-order. Upon receiving ZDM 3 and adding allocated port C, the dataforwarder (DF) 6 a, 6 n may then add ACL entries 268 for all remainingports A and C in the network 1.

FIG. 12 illustrates an example of the result of the operations performedin FIGS. 5-9 on zone information when processing four zone distributionmessages ZDM 1, ZDM 2, ZDM 3, and ZDM 4 for ports A, B, C, and D. ZDM 1is sent to allocate port C and provide peer information for ports A, B,and C. In ZDM 2, port D is allocated and provides peering entries forlinks between A, B, C, and D. In ZDM 3, port B is deallocated withpeering entries for links between A, C, D. ZDM 4 allocates port C andprovides peering entries for links between A, C, and D. FIG. 12 shows atimeline 270 of the zone distribution messages sent between thecontrolling forwarder (CF) 4 and a data forwarder (DF) 6 a, 6 b, whichshows that the data forwarder (DF) receives ZDM 2 and ZDM3 before ZDM 1.Because the messages are sent out of order, the data forwarder (DF)sends a rejection message (RJT) with respect to ZDM 1, which causes thecontrolling forwarder (CF) to send a rebuilt zone distribution messageZDM 4 according to the operations of FIG. 8 that indicates the port Callocated in the rejected ZDM 1 and includes all the peering entries forthe ports A, C, and D. The ACL entries 272 shows how the data forwarder(DF) 6 a, 6 b adds ACL entries 50 to the zone information 28 a, 28 b asa result of ZDM 2, ZDM 3 and the rebuilt message ZDM 4 Initially, thereare ACL entries 274 for ports A and B. For ZDM 2, the port D ACL entryis added and the port A and B ACL entries are updated to indicate linksbetween A, B, C and D for ports A, B, and D. There is no ACL entry forport C because ZDM 1 allocating port C has not yet arrived, although thelinks to port C are shown in the ACL entries 278 for ports A and D. Uponreceiving rebuilt message ZDM 4 adding allocated port C, the dataforwarder (DF) 6 a, 6 n may then add ACL entries 2280 for all allocatedports A, C, and D in the network 1.

FIG. 13 illustrates an example of the result of the operations performedin FIGS. 5-9 on zone information when processing four zone distributionmessages ZDM 1, ZDM 2, ZDM 3, and ZDM 4 for ports A, B, C, and D, whichare in two zones 1 and 2 having ports A, B, C and ports B, C, D,respectively, according to FIGS. 5-9. ZDM 1 is sent to allocate port Cand provide peer information for ports A, B, and C. In ZDM 2, port D isallocated and provides peering entries for links between A, B, C, and D,where ports A and D are in different zones. In ZDM 3, port B isdeallocated with peering entries for links between A, C, D. ZDM 4allocates port C and provides peering entries for links between A, C,and D. FIG. 13 shows a timeline 282 of the zone distribution messagessent between the controlling forwarder (CF) 4 and a data forwarder (DF)6 a, 6 b, which shows that the data forwarder (DF) receives ZDM 2 andZDM3 before ZDM 1. Because the messages are sent out of order, the dataforwarder (DF) sends a rejection message (RJT) with respect to ZDM 1,which causes the controlling forwarder (CF) to send a rebuilt zonedistribution message ZDM 4 according to the operations of FIG. 8 thatindicates the port C, allocated in the rejected ZDM 1, and includes allthe peering entries for the ports A, C, and D. The ACL entries 284 showhow the data forwarder (DF) 6 a, 6 b adds ACL entries 50 to the zoneinformation 28 a, 28 b as a result of ZDM 2, ZDM 3 and the rebuiltmessage ZDM 4 Initially, there are ACL entries 286 for ports A and B.For ZDM 2, the port D ACL entry is added and the port A and B ACLentries 288 are updated to indicate links between A, B, C and D forports A, B, and D. There is no entry in ACL entries 288 for port Cbecause ZDM 1 allocating port C has not yet arrived, although the linksto port C are shown in the ACL entries 288 for ports B and D. Uponreceiving ZDM3, the ACL entries 290 are updated to remove the entry forport B, which is deallocated, and update the ACL entries 290 for A and Dto remove references to deallocated port B according go the operationsof FIG. 5. Links to port C are added to the ACL entries 290 for port Aalthough there is no port C allocated peering entry for port A providesa link for port .C. Upon receiving rebuilt message ZDM 4 addingallocated port C, the data forwarder (DF) 6 a, 6 n may then add ACLentries 292 for all allocated ports A, C, and D in the network 1.

Described embodiments provide techniques for updating zone informationin a distributed switch comprised of forwarders by using sequencenumbers at the controlling forwarder and data forwarders to have thedata forwarders reject received zone distribution messages having asequence number lower than the last accepted and processed zonedistribution message. If a zone distribution message is rejected, thecontrolling forwarder rebuilds a zone distribution message to indicatethe allocated/deallocated port in the rejected message and provide thecurrent set of links between ports. Described embodiments provide forthe handling of zone distribution messages received out of order toprovide for updating zone information when ports have not been allocatedor deallocated according to the order in which the zone distributionmessages are received.

The described operations may be implemented as a method, apparatus orcomputer program product using standard programming and/or engineeringtechniques to produce software, firmware, hardware, or any combinationthereof. Accordingly, aspects of the embodiments may take the form of anentirely hardware embodiment, an entirely software embodiment (includingfirmware, resident software, micro-code, etc.) or an embodimentcombining software and hardware aspects that may all generally bereferred to herein as a “circuit,” “module” or “system.” Furthermore,aspects of the embodiments may take the form of a computer programproduct embodied in one or more computer readable medium(s) havingcomputer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent invention may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present invention are described above with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

The terms “an embodiment”, “embodiment”, “embodiments”, “theembodiment”, “the embodiments”, “one or more embodiments”, “someembodiments”, and “one embodiment” mean “one or more (but not all)embodiments of the present invention(s)” unless expressly specifiedotherwise.

The terms “including”, “comprising”, “having” and variations thereofmean “including but not limited to”, unless expressly specifiedotherwise.

The enumerated listing of items does not imply that any or all of theitems are mutually exclusive, unless expressly specified otherwise.

The terms “a”, “an” and “the” mean “one or more”, unless expresslyspecified otherwise.

Devices that are in communication with each other need not be incontinuous communication with each other, unless expressly specifiedotherwise. In addition, devices that are in communication with eachother may communicate directly or indirectly through one or moreintermediaries.

A description of an embodiment with several components in communicationwith each other does not imply that all such components are required. Onthe contrary a variety of optional components are described toillustrate the wide variety of possible embodiments of the presentinvention.

Further, although process steps, method steps, algorithms or the likemay be described in a sequential order, such processes, methods andalgorithms may be configured to work in alternate orders. In otherwords, any sequence or order of steps that may be described does notnecessarily indicate a requirement that the steps be performed in thatorder. The steps of processes described herein may be performed in anyorder practical. Further, some steps may be performed simultaneously.

When a single device or article is described herein, it will be readilyapparent that more than one device/article (whether or not theycooperate) may be used in place of a single device/article. Similarly,where more than one device or article is described herein (whether ornot they cooperate), it will be readily apparent that a singledevice/article may be used in place of the more than one device orarticle or a different number of devices/articles may be used instead ofthe shown number of devices or programs. The functionality and/or thefeatures of a device may be alternatively embodied by one or more otherdevices which are not explicitly described as having suchfunctionality/features. Thus, other embodiments of the present inventionneed not include the device itself.

The illustrated operations of the figures show certain events occurringin a certain order. In alternative embodiments, certain operations maybe performed in a different order, modified or removed. Moreover, stepsmay be added to the above described logic and still conform to thedescribed embodiments. Further, operations described herein may occursequentially or certain operations may be processed in parallel. Yetfurther, operations may be performed by a single processing unit or bydistributed processing units.

The foregoing description of various embodiments of the invention hasbeen presented for the purposes of illustration and description. It isnot intended to be exhaustive or to limit the invention to the preciseform disclosed. Many modifications and variations are possible in lightof the above teaching. It is intended that the scope of the invention belimited not by this detailed description, but rather by the claimsappended hereto. The above specification, examples and data provide acomplete description of the manufacture and use of the composition ofthe invention. Since many embodiments of the invention can be madewithout departing from the spirit and scope of the invention, theinvention resides in the claims herein after appended.

What is claimed is:
 1. A computer program product for managing zoninginformation for ports in a network and in communication with dataforwarders, the computer program product comprising a non-transitorycomputer readable storage medium having computer readable program codeembodied therein that executes to perform operations, the operationscomprising: maintaining for each data forwarder a sequence number forzone distribution messages sent to the data forwarder; detecting achange to the ports in the network comprising at least one of anallocation or deallocation of at least one port in the network;incrementing the sequence number for each data forwarder in response todetecting the change; generating for each data forwarder a zonedistribution message indicating the at least one port allocated and/ordeallocated, port information indicating each port in the network thatmay communicate with each other port, and the sequence number for thedata forwarder, wherein the data forwarder uses the sequence number todetermine whether the zone distribution message was received out oforder with respect to a last processed zone distribution message at thedata forwarder; and transmitting the zone distribution message generatedfor each data forwarder to the data forwarder for which the zonedistribution message was generated.
 2. The computer program product ofclaim 1, wherein the operations further comprise: receiving from arejecting data forwarder comprising one of the data forwarders arejection message rejecting an identified zone distribution messagetransmitted to the rejecting data forwarder; incrementing the sequencenumber for the rejecting data forwarder in response to receiving therejection message; determining the at least one port allocated and/ordeallocated in the rejected zone distribution message; generating a newzone distribution message indicating the at least one port allocatedand/or deallocated in the identified rejected zone distribution messageand the sequence number; and transmitting the new zone distributionmessage to the rejecting data forwarder.
 3. The computer program productof claim 2, wherein the operations further comprise: including in thenew zone distribution message port information indicating each port inthe network that may communicate with each other port in the network. 4.The computer program product of claim 1, wherein the operations furthercomprise: processing a zone reset operation to reset the zoneinformation in the network; resetting the sequence numbers for the dataforwarders to an initial value in response to detecting the zone resetoperation; and sending a zone reset message to the data forwarders tocause the data forwarders to reset their zone information and resettheir zone distribution message sequence numbers to zero.
 5. Thecomputer program product of claim 1, wherein the ports in the networkprovide communication with host systems using a first networkcommunication protocol, and wherein a second network communicationprotocol is used to communicate with the data forwarders.
 6. Thecomputer program product of claim 5, wherein the first networkcommunication protocol comprises Fibre Channel, wherein the dataforwarders comprise Fibre Channel Over Ethernet (FCoE) data forwardersthat form a Distributed Fibre Channel Fabric, and wherein the secondcommunication protocol comprises Ethernet.
 7. A computer program productfor managing zoning information for ports in a network and incommunication with a controlling forwarder, the computer program productcomprising a non-transitory computer readable storage medium havingcomputer readable program code embodied therein that executes to performoperations, the operations comprising: maintaining the zoninginformation indicating each port that may communicate with each otherport in the network and a last received sequence number included in alast accepted zone distribution message; receiving from the controllingforwarder a zone distribution message indicating at least one portallocated and/or deallocated, port information indicating each port inthe network that may communicate with each other port in the network,and the sequence number indicating a sequence number of the zonedistribution message; determining whether the sequence number in thezone distribution message is greater than the last received sequencenumber; and updating the zone information to indicate the at least oneport allocated and/or deallocated and include information on the portsin the network that may communicate with each other port in response todetermining that the sequence number in the zone distribution message isgreater than the last received sequence number.
 8. The computer programproduct of claim 7, wherein the operations further comprise: updatingthe last received sequence number to indicate the sequence number in thereceived zone distribution message in response to determining that thatthe sequence number in the zone distribution message is greater than thelast received sequence number; and sending an accept zone distributionmessage to the controlling forwarder in response to determining thatthat the sequence number in the zone distribution message is greaterthan the last received sequence number.
 9. The computer program productof claim 7, wherein the operations further comprise: sending a rejectionmessage to the controlling forwarder indicating a rejection of the zonedistribution message in response to determining that the sequence numberin the zone distribution message is not greater than the last receivedsequence number, wherein the zone information is not updated with theinformation in the rejected zone distribution message.
 10. The computerprogram product of claim 7, wherein the zone distribution messageincludes a peering entry for each port in the network indicating theports with which the port may communicate in the network, wherein theupdating the zone information comprises: maintaining zone informationindicating ports in the network; determining whether the peering entriesin the zone distribution message identify ports in the zone information;and updating the zone information with information in the peeringentries for ports indicated in the zone information, wherein the zoneinformation is not updated with information in peering entries for portsnot indicated in the zone information.
 11. The computer program productof claim 10, wherein the updating the zone information comprises:updating the zone information to indicate the at least one port asallocated and/or deallocated in the zone distribution message, whereinthe determining from the zone information whether the peering entries inthe zone distribution message are indicated in the zone information isperformed after updating the zone information to indicate the at leastone port allocated and/or deallocated.
 12. The computer program productof claim 7, wherein the ports in the network provide communication withhost systems using a first network communication protocol, and wherein asecond network communication protocol is used to communicate with thecontrolling forwarder.
 13. The computer program product of claim 12,wherein the first network communication protocol comprises FibreChannel, wherein the controlling forwarder comprises a controlling FibreChannel Over Ethernet (FCoE) forwarder to manage zone information indata FCoE data forwarders, and wherein the second communication protocolcomprises Ethernet.
 14. A system for managing zoning information forports in a network and in communication with data forwarders,comprising: a controller for performing operations, the operationscomprising: maintaining for each data forwarder a sequence number forzone distribution messages sent to the data forwarder; detecting achange to ports in the network comprising at least one of an allocationor deallocation of at least one port in the network; incrementing thesequence number for each data forwarder in response to detecting thechange; generating for each data forwarder a zone distribution messageindicating the at least one port allocated and/or deallocated, portinformation indicating each port in the network that may communicatewith each other port, and the sequence number for the data forwarder,wherein the data forwarder uses the sequence number to determine whetherthe zone distribution message was received out of order with respect toa last processed zone distribution message at the data forwarder; andtransmitting the zone distribution message generated for each dataforwarder to the data forwarder for which the zone distribution messagewas generated.
 15. The system of claim 14, wherein the operationsfurther comprise: receiving from a rejecting data forwarder comprisingone of the data forwarders a rejection message rejecting an identifiedzone distribution message transmitted to the rejecting data forwarder;incrementing the sequence number for the rejecting data forwarder inresponse to receiving the rejection message; determining the at leastone port allocated and/or deallocated in the rejected zone distributionmessage; generating a new zone distribution message indicating the atleast one port allocated and/or deallocated in the identified rejectedzone distribution message and the sequence number; and transmitting thenew zone distribution message to the rejecting data forwarder.
 16. Thesystem of claim 15, wherein the operations further comprise: includingin the new zone distribution message port information indicating eachport in the network that may communicate with each other port in thenetwork.
 17. A system for managing zoning information for ports in anetwork and in communication with a controlling forwarder, comprising: acontroller for performing operations, the operations comprising:maintaining the zone information indicating each port that maycommunicate with each other port in the network and a last receivedsequence number included in a last accepted zone distribution message;receiving from the controlling forwarder a zone distribution messageindicating at least one port allocated and/or deallocated, portinformation indicating each port in the network that may communicatewith each other port in the network, and the sequence number indicatinga sequence number of the zone distribution message; determining whetherthe sequence number in the zone distribution message is greater than thelast received sequence number; updating the zone information to indicatethe at least one port allocated and/or deallocated and includeinformation on the ports in the network that may communicate with eachother port in response to determining that the sequence number in thezone distribution message is greater than the last received sequencenumber.
 18. The system of claim 17, wherein the operations furthercomprise: updating the last received sequence number to indicate thesequence number in the received zone distribution message in response todetermining that that the sequence number in the zone distributionmessage is greater than the last received sequence number; and sendingan accept zone distribution message to the controlling forwarder inresponse to determining that that the sequence number in the zonedistribution message is greater than the last received sequence number.19. The system of claim 17, wherein the operations further comprise:sending a rejection message to the controlling forwarder indicating arejection of the zone distribution message in response to determiningthat the sequence number in the zone distribution message is not greaterthan the last received sequence number, wherein the zone information isnot updated with the information in the rejected zone distributionmessage.
 20. The system of claim 17, wherein the zone distributionmessage includes a peering entry for each port in the network indicatingthe ports with which the port may communicate in the network, whereinthe updating the zone information comprises: maintaining zoneinformation indicating ports in the network; determining whether thepeering entries in the zone distribution message identify ports in thezone information; and updating the zone information with information inthe peering entries for ports indicated in the zone information, whereinthe zone information is not updated with information in peering entriesfor ports not indicated in the zone information.
 21. The system of claim20, wherein the updating the zone information comprises: updating thezone information to indicate the at least one port as allocated and/ordeallocated in the zone distribution message, wherein the determiningfrom the zone information whether the peering entries in the zonedistribution message are indicated in the zone information is performedafter updating the zone information to indicate the at least one portallocated and/or deallocated.
 22. The system of claim 17, wherein theoperations further comprise: processing a zone reset operation to resetthe zone information in the network; resetting the sequence numbers forthe data forwarders to an initial value in response to detecting thezone reset operation; and sending a zone reset message to the dataforwarders to cause the data forwarders to reset their zone informationand reset their zone distribution message sequence numbers to zero. 23.The system of claim 17, wherein the ports in the network providecommunication with host systems using a first network communicationprotocol, and wherein a second network communication protocol is used tocommunicate with the data forwarders.
 24. The system of claim 23,wherein the first network communication protocol comprises FibreChannel, wherein the data forwarders comprise Fibre Channel OverEthernet (FCoE) data forwarders that form a Distributed Fibre ChannelFabric, and wherein the second communication protocol comprisesEthernet.
 25. The system of claim 17, wherein the ports in the networkprovide communication with host systems using a first networkcommunication protocol, and wherein a second network communicationprotocol is used to communicate with the controlling forwarder.
 26. Thesystem of claim 25, wherein the first network communication protocolcomprises Fibre Channel, wherein the controlling forwarder comprises acontrolling Fibre Channel Over Ethernet (FCoE) forwarder to manage zoneinformation in data FCoE data forwarders, and wherein the secondcommunication protocol comprises Ethernet.